Korean named entity recognition based on language-specific features
نویسندگان
چکیده
Abstract In this paper, we propose a novel way of improving named entity recognition (NER) in the Korean language using its language-specific features. While field NER has been studied extensively recent years, mechanism efficiently recognizing entities (NEs) hardly explored. This is because distinct linguistic properties that present challenges for modeling. Therefore, an annotation scheme corpora by adopting CoNLL-U format, which decomposes words into morphemes and reduces ambiguity NEs original segmentation may contain functional such as postpositions particles, proposed herein. We investigate how NE tags are best represented morpheme-based implement algorithm to convert word-based syllable-based with format. Analyses results traditional neural models reveal format feasible, varied performances under influence various additional features demonstrated. Extrinsic conditions were also considered observe variance models, given different types data, including tagging formats.
منابع مشابه
A Novel Approach to Conditional Random Field-based Named Entity Recognition using Persian Specific Features
Named Entity Recognition is an information extraction technique that identifies name entities in a text. Three popular methods have been conventionally used namely: rule-based, machine-learning-based and hybrid of them to extract named entities from a text. Machine-learning-based methods have good performance in the Persian language if they are trained with good features. To get good performanc...
متن کاملNamed entity recognition: Exploring features
We study a comprehensive set of features used in supervised named entity recognition. We explore various combinations of features and compare their impact on recognition performance. We build a conditional random field based system that achieves 91.02% F1-measure on the CoNLL 2003 (Sang and Meulder, 2003) dataset and 81.4% F1-measure on the OntoNotes version 4 (Hovy et al., 2006) CNN dataset, w...
متن کاملUsing Language Independent and Language Specific Features to Enhance Arabic Named Entity Recognition
The Named entity recognition task has been garnering significant attention as it has been shown to help improve the performance of many natural language processing applications. More recently, we are starting to see a surge in developing named entity recognition systems for languages other than English. With the relative abundance of resources for the Arabic language and a certain degree of mat...
متن کاملFeatures for Named Entity Recognition in Czech Language
This paper deals with Named Entity Recognition (NER). Our work focuses on the application for the Czech News Agency (ČTK). We propose and implement a Czech NER system that facilitates the data searching from the ČTK text news databases. The choice of the feature set is crucial for the NER task. The main contribution of this work is thus to propose and evaluate some different features for the na...
متن کاملLanguage Independent Named Entity Recognition
The role of Internet in personal, economic and political advancement is growing in a fast pace. By the turn of century, data on web reaches to petabytes or exabytes or may even scale up-to unimaginable quantities. Extraction of precise and structured information from such large amounts of unstructured or semi-structured data is the major concern of web known as Information Extraction. Named ent...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Natural Language Engineering
سال: 2023
ISSN: ['1469-8110', '1351-3249']
DOI: https://doi.org/10.1017/s1351324923000311